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Abstract 

Three results are presented: First, we solve the problem of persistence of dissi- 
pation for reduction of kinetic models. Kinetic equations with thermodynamic Lya- 
punov functions are studied. Uniqueness of the thermodynamic projector is proven: 
There exists only one projector which transforms any vector field equipped with the 
given Lyapunov function into a vector field with the same Lyapunov function for a 
given ansatz manifold which is not tangent to the Lyapunov function levels. 

Second, we use the thermodynamic projector for developing the short memory 
approximation and coarse-graining for general nonlinear dynamic systems. We prove 
that in this approximation the entropy production increases. [The theorem about 
entropy overproduction.) 

In example, we apply the thermodynamic projector to derivation the equations of 
reduced kinetics for the Fokker-Planck equation. A new class of closures is developed, 
the kinetic multipeak polyhedra. Distributions of this type are expected in kinetic 
models with multidimensional instability as universally, as the Gaussian distribution 
appears for stable systems. The number of possible relatively stable states of a 
nonequilibrium system grows as 2*", and the number of macroscopic parameters is 
in order mn, where n is the dimension of configuration space, and m is the number 
of independent unstable directions in this space. The elaborated class of closures 
and equations pretends to describe the effects of "molecular individualism" . This is 
the third result. 
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Introduction 



Reduction of description for dissipative kinetics assumes (explicitly or implicitly) the following 
picture: There exists a manifold of slow motions in the space of distributions. From the initial 
conditions the system goes quickly in a small neighborhood of the manifold, and after that 
moves slowly along it. 

There are three basic problems in the model reduction: 

(1) How to construct the slow manifold; 

(2) How to project the initial equation onto the constructed slow manifold, i.e. how to split 
motions into fast and slow; 

(3) How to improve the constructed manifold and the projector in order to make the manifold 
more invariant and the motion along it slower. 

The first problem is often named "the closure problem" , and its solution is the closure assump- 
tion; the second problem is "the projection problem" . Sometimes these problems are discussed 
and solved simultaneously (for example, for the quasiequilibrium, or, which is the same, for 
MaxEnt closure assumptions [1,2,3,4,5]). Sometimes solution of the projection problem after 
construction of ansatz takes a long time. The known case of such a problem gives us the Tamm- 
Mott-Smith approximation in the theory of shock waves (see, for example, [7]). However if one 
has constructed the closure assumption which is at the same time the invariant manifold [7,8,9], 
then the projection problem disappears, because the vector field is always tangent to the in- 
variant manifold. 

Let us discuss the initial kinetic equation as an abstract ordinary differential equation ^ , 



where ^ = ^{o) is the distribution function, q is the point in configuration space (for the 
Fokker-Planck equation) or in phase space (for the Liouville equation). 

Let the closure assumption be given: 

* = *(M|g), (2) 
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^ Many of partial differential kinetic equations or integro-differential kinetic equations with suitable 
boundary conditions (or conditions at infinity) can be discussed as abstract ordinary differential equa- 
tion in appropriate space of functions. The corresponding semigroup of shifts in time can be considered 
too. For example, the Fokker-Planck equation in a potential well U (q) with a condition U {q)/\\q\\'^ — oo 
for \\q\\ — > oo and some a > generates an analytical semigroup. It allows to discuss the Fokker-Planck 
equation in such a well on the same way as an ordinary differential equation. Sometimes, when an 
essential theorem of existence and uniqueness of solution is not proven, it is possible to discuss a 
corresponding shift in time with the support of physical sense: the shift in time for physical system 
should exist. Benefits from the latter approach are obvious as well as its risk. 



where M is the set of macroscopic variables, which are coordinates on the manifold (2). The 
tangent space Tmq for the manifold (2) in the point Mq is the image of the differential: 



Tmo =ini(r>M(*(M|?))Mo- 



(3) 



How to construct the dynamic equation for the variables M? This is the projection problem. 
The equivalent setting is: how to project J(*(Mo|g)) onto Tmq? If dM/dt = F{M) is the 
equation for M, then the equation on the manifold is d'^{M\q)/dt = (i:>M*(-/W|g)) • F{M). 

There exist three common ways to construct the projector onto Tmq' 

(1) Moment parametrization; 

(2) Spectral projectors of Jacobians for equation (1); 

(3) Spectral projectors of "symmetric part" of Jacobians for this equation. 

The moment parametrization is the best way to "hide" the projector problem in a natural 
way: Let the macroscopic variables be defined not only on the manifold \E'(M|g), but in the 
neighborhood of this manifold: M = m(^'), with the identity m(^'(M|g)) = M. Then we can 
define dM/dt in a natural way: 



As it will be demonstrated below, this simple formula is appropriate only for the quasiequilib- 
rium (MaxEnt) approximation, because in other cases it leads to entropy decreasing for some 
initial conditions and, hence, to a perpetuum mobile of the second kind (this happens in reduced 
equations, of course, and not in reality). 

The idea of slow-fast decomposition through spectral decomposition of Jacobian seems attrac- 
tive (see, for example, the theory of the so-called intrinsic low-dimensional manifold (ILDM) 
[10]): Let the spectrum of Z^^ J(^) can be separated in two parts: ReAsi < A <^ B < RcAfst < 0. 
There are two invariant subspaces which correspond to slow (£"31) and to fast (-Efst) points of 
the spectrum. The suggested solution of the projection problem is: The tangent space Tm of 
the slow manifold should be not very different from the slow invariant subspace E'gi, and the 
projection of J onto Tm should be done parallel to the fast invariant subspace E^st- 

The eigenvectors and eigenprojectors of the non- self adjoint operators may be very unstable in 
calculations. So, it may be better to use the selfadjoint operator and it's spectral decomposition. 

Dynamics of distances depends not on the Jacobian, but on the symmetrized Jacobian: 



where ( , ) is usual scalar product, A^^ is difference between two solutions of equation (1), 
^ — ^{t) is one of these solutions. 



dM 



{D^m{^{M\q)))J{^{M\q)). 



(4) 



dt 



d{A^, A*) 
di 



(A^, [L'^J(^) + (i^vp J(*))+]A^) + o(A^), 



In the theory of inertial manifolds [11,12,13], for example, one usually uses the following form 
of equation (1) with selfadjoint hnear operator A: 4f + A^ — -R(^), and spectral decomposition 
of A rules the fast-slow splitting. 



There are different physically motivated ways to select the scalar product and create the sym- 
metrization [f4,f5,f6]. But symmetrization does not provide termodinamicity and the entropy 
for the projected equations can decrease. 



The construction of the thermodynamic projector which always preserve the dissipation is 
simple and transparent. We shall describe it now, in the introduction, and it's uniqueness will 
be proved in the next section. The proof of uniqueness will demonstrate, that all other ways 
of projection are thermodynamically inconsistent, and lead to entropy decrease, and, hence, to 
the perpetuum mobile of the second kind. 

Let for the system (1) the entropy exist, and 

^ = {D^S)m > 0. (5) 

We introduce the entropic scalar product ( | 

{a\b)^ = -{a,{DlS){b)), (6) 

where D^S is the second differential of the entropy. 

The thermodynamic projector is defined for a given point ^ and a subspace T (the tangent 
space to an ansatz manifold). Let us consider a subspace Tq G T which is annulled by the 
differential S in the point {D-^S)To = 0. If Tq = T, then the thermodynamic projector 
is the orthogonal projector on T with respect to the entropic scalar product ( | Suppose 
that Tq ^ T. Let tg e T, Cg 1. Tq with respect to the entropic scalar product ( | and 
{Dii,S){eg) = 1. These conditions define vector Cg uniquely. The projector onto T is defined by 
the formula 

P{J) = Po{J) + eg{D^S){J), (7) 

where Pq is the orthogonal projector onto Tq with respect to the entropic scalar product ( | 

For example, if T is a finite-dimensional space, then the projector (7) is constructed in the 
following way. Let Ci, .., e„ be a basis in T, and for definiteness, (D^5')(ei) ^ 0. 

1) Let us construct a system of vectors 

6i = Cj+i - AjCi, (i = 1, ..,n - 1), (8) 

where Aj = (D^5')(ej+i)/(D^5')(ei), and hence (L>^S')(6j) — 0. Thus, {bi}i~^ is a basis in Tq. 

2) Let us orthogonalize with respect to the entropic scalar product ( | )^. We get an 
orthonormal with respect to ( | basis {gi}i~^ in Tq. 

3) We find Cg G T from the conditions: 

{eg I 9i)^ = 0, (i = 1, .., n-1), {D^S){eg) = L (9) 



and, finally we get 



n— 1 



P{J) ^T.9i{9i I Jh + eg{D^S){J) (10) 



1=1 



If {DxiiS)(T) — 0, then the projector P is simply the orthogonal projector with respect to the 
( I )^ scalar product. This is possible if ^ is the global maximum of entropy point (equilibrium). 
Then 

n 

P{J) = ^9i{9i\J)-^, {9i\9j)^ = ^ij- (11) 
1=1 

The entropy production for projected vector field (10) is the same, as for the initial vector field 
(1): 

{D^S){P{J)) = {D^S){eg){D^S){J). (12) 

The significance of the case (D^5')(T) = may be not clear at the first glance, because such a 
state ^ should be the equilibrium point with J(^') = 0. Nevertheless, this case is important as 
a limit of nonequilibrium and for discussion of persistence of the Onsager relations^ [6] as 
well, as for the proof of uniqueness the thermodynamic projector. 

In this paper we do not discuss the third main problem of model reduction: How to improve 
the constructed manifold and the projector in order to make the manifold more invariant and 
the motion along it more slow. This discussion can be found in different works [7,8,9,11,12,16]. 

The discovery of the molecular individualism for dilute polymers in the flow [17] was the 
challenge to theory from the very beginning. "Our data should serve as a guide in developing 
improved microscopic theories for polymer dynamics"... was the concluding sentence of the 
paper [17]. P. de Gennes invented the term "molecular individualism" [18]. He stressed that in 
this case the usual averaging procedures are not applicable. At the highest strain rates distinct 
conformation shapes with different dynamics were observed [17]. Further works for shear flow 
demonstrated not only shape differences, but different large temporal fluctuations [19]. 

Equation for the molecules in a flow are known. These are the Fokker-Planck equations with 
external force. The theory of the molecular individualism is hidden inside these equations. 
Following the logic of model reduction we should solve two problems: to construct the slow 
manifold, and to project the equation on this manifold. The second problem is solved: the 
thermodynamic projector is necessary for this projection. Why should we use this projector 
also for driven systems? These systems can be formally written as 

— = J(^) + Jex, (13) 



^ The preservation of the Onsager reciprocity relations for projected equations follows from the re- 
quirement of persistence of the sign of dissipation. This seems surprising, because these relations do 
not follow from the entropy grows. It should be stressed, that only the conditional statement can be 
proved: if for the initial system hold the Onsager reciprocity relations, then these relations hold for 
the projected system. 



where Jex is the external field (driven force). 

The entropy for system (13) can decrease, but the thermodynamic processes modeled by the 
term J(\l') should always produce the entropy (both in the initial and in the projected systems). 
This is the reason to use the thermodynamic projector also for open systems. 

How to solve the first problem? We can find a hint in the paper [20]. The Gaussian distribu- 
tions form the invariant manifold for the FENE-P model of polymer dynamics, but, as it was 
discovered in [20] , this manifold can become unstable in the presence of a flow. We propose to 
model this instability as dissociation of the Gaussian peak into two peaks. This dissociation 
describes appearance of an unstable direction in the configuration space. 

In the classical FENE-P model of polymer dynamics a polymer molecule is represented by one 
coordinate: the stretching of molecule (the connector vector between the beads) . There exists a 
simple mean field generalized models for multidimensional configuration spaces of molecules. In 
these models dynamics of distribution functions is described by the Fokker-Planck equation in 
a quadratic potential well. The matrix of coefficients of this quadratic potential depends on the 
matrix of the second order moments of the distribution function. The Gaussian distributions 
form the invariant manifold for these models, and the first dissociation of the Gaussian peak 
after appearance of the unstable direction in the configuration space has the same nature and 
description, as for the one-dimensional models of molecules considered below. 

At the highest strain there can appear new unstable directions, and corresponding dissociations 
of Gaussian peaks form a cascade of dissociation. For m unstable directions we get the Gaussian 
parallelepiped: The distribution function is represented as a sum of 2"* Gaussian peaks located 
in the vertixes of parallelepiped: 

*(«) = 

2-.(2.)-)^V5iFE ,.,,g,...„;-'(-^ ('^P") • '^m) • 

where n is dimension of configuration space, 2q is the vector of the ith edge of the parallelepiped, 
E is the one peak covariance matrix (in this model E is the same for all peaks) . The macroscopic 
variables for this model are: 

(1) The covariance matrix S for one peak; 

(2) The set of vectors q (or the parallelepiped edges). 

The family of distributions (14) can be improved to include the proper equilibrium (this is 
important condition: the equilibrium should belong to the ansatz manifold). There may be 
different further refinements, some of them are discussed below. 



1 Uniqueness of thermodynamic projector 

In this section, the uniqueness theorem for thermodynamic projector will be proved. 



1.1 Projection of linear vector field 



Let £■ be a real Hilbert space with the scalar product ( | ), Q be a set of linear bounded 
operators in E with negatively definite quadratic form {Ax \ x) < for every A E Q, T ^ E 
be a nontrivial (T 7^ {0}) closed subspace. For every projector P : E ^ T (P^ = P) and linear 
operator A : E E we define the projected operator P{A) : T — > T in such a way: 

P{A)x = PAx = PAPx for xeT. (15) 

The space T is the Hilbert space with the scalar product ( | ) . Let Qt be a set of hnear bounded 
operators in T with negatively define quadratic form {Ax \ x) < 0. 

Proposition 1. The inclusion P{Q) C Qrp for a projector P : E ^ T holds if and only if P is 
the orthogonal projector with respect to the scalar product ( | ) . 

Proof. If P is orthogonal (and, hence, selfadjoint) and {Ax | x) < 0, then 

{PAPx I x) = {APx I Px) < 0. 

If P is not orthogonal, then Px ^ for some vector x e T-^ in orthogonal complement of T. 
Let us consider the negatively defined selfadjoint operator 

Ax = — \ Px — ax) {Px — ax \ 
{A^y — —(Px — ax){Px — ax \ y)). The projection of A^ on T is: 

P{Ax) = (a - 1) I Px){Px I . 
This operator is not negatively definite for a > 1. □ 
Immediately from this proof follows the Corollary 1. 

Corollary 1. Let Q*^^"^ G Q be a subset of selfadjoint operators in E. The inclusion P{Q^^^) C 
Qt for a projector P : E T holds if and only if P is the orthogonal projector with respect to 
the scalar product ( | ) . □ 

Corollary 2. Let C Qt be a subset of selfadjoint operators in T. If P{Q) C Qt for a 
projector P :E ^T, then P(g^y") C g^^". 

It follows from the Proposition 1 and the obvious remark: If operators A and P are selfadjoint, 
then operator PAP is selfadjoint too. □ 

The Proposition 1 means that a projector which transforms every linear vector field Ax with 
Lyapunov function {x \ x) into projected vector field PAPx with the same Lyapunov function 
is orthogonal with respect to the scalar product ( | ) . 

According to the Corollary 1, the conditions of the Proposition 1 can be made weaker: A 
projector which transforms every selfadjoint linear vector field Ax with Lyapunov function 
{x I x) into projected vector field PAPx with the same Lyapunov function is orthogonal with 



respect to the scalar product ( | ). In physical applications it means, that we can deal with 
requirement of dissipation persistence for vector field with Onsager reciprocity relations. The 
consequence of such a requirement will be the same, as for the class of all continuous linear 
vector field: The projector should be orthogonal. 

The Corollary 2 is a statement about persistence of the reciprocity relations. 



1.2 The uniqueness theorem 

In this subsection we will discuss finite-dimensional systems. There are technical details which 
make the theory of nonlinear infinite- dimensional case too cumbersome: the Hilbert space 
equipped with entropic scalar product ( | )^ (12) for different ^ consists of different functions. 
Of course, there exists a common dense subspace, and geometrical sense remains the same, as 
for the finite-dimensional space, but we prefer to defer the discussion of all these details till a 
special mathematical publication. 

Let E be n-dimensional real vector space, U (Z E he a domain in E, and a m-dimensional space 
of parameters L be defined, m < n, and let 1^ be a domain in L. We consider differentiable 
maps, F : W ^ U, such that, for every y e W, the differential of F, DyF : L — > is an 
isomorphism of L on a subspace of E. That is, F are the manifolds, immersed in the phase 
space of the dynamic system (1), and parametrized by parameter set W. 

Let the twice differentiable function S on U be given (the entropy). We assume that S is strictly 
concave in the second approximation: The quadratic form defined by second differential of the 
entropy D'^S{x,x) is strictly negative definite in E for every ^ G f/. We will use the entropic 
scalar product (6). Let S have the interior point of maximum in U: \E''^'^ G intt/. 

The function S is Lyapunov function for a vector field J in [/, if (D^5')(J(^)) > for every 
* G C/. 

First of all, we shall study vector fields with Lyapunov function S in the neighborhood of 
Let G intW, F : W ^ U he an immersion, and F(0) = ^f^^. Let us define Ty — imDyF{y) for 
each y E W. This Ty is the tangent space to F(W) in the point y. Suppose that the mapping 
F is sufficiently smooth, and F{W) is not tangent to entropy levels: 

Ty ^ ker Dis,S\q,=F{y) 

for every y ^ 0. The thermodynamic projector for a given F is a projector- valued function 
y (-^ Py, where Py : E ^ Ty is a projector. The thermodynamic conditions reads: For every 
smooth vector field J(^I') in U with Lyapunov function S the projected vector field Py{J{F{y))) 
on F{W) has the same Lyapunov function S{F{y)). 

Proposition 1 and Corollaries 1, 2 make it possible to prove uniqueness of the thermodynamic 
projector for the weakened thermodynamic conditions too: For every smooth vector field J(^) 
in U with Lyapunov function S and selfadjoint Jacobian operator for every equilibrium point 
(zero of J{^) ) the projected vector field Py{J{F{y))) on F{W) has the same Lyapunov function 
S{F{y)). We shall not discuss it separately. 



Proposition 2. Let the thermodynamic projector Py be a smooth function ofy. Then 

Po = and Py = P^ + 0(2/), (16) 

where Py is orthogonal projector onto Ty with respect to the entropic scalar product ( | ) F{y) ■ 

Proof. A smooth vector field in the neighborhood of -F(O) = ^^'^ can be presented as — 
^^'^) + o(||\l/ — \E'^'^||), where A is a hnear operator. If S is Lyapunov function for this vector 
field, then the quadratic form {Ax \ a;),i,cq is negatively definite. Py = Pq + 0{y), because Py 
is a continuous function. Hence, for Pq we have the problem solved by the Proposition 1, and 
Po = Po^. □ 

Theorem 1. Let the thermodynamic projector Py be a smooth function ofy. Then 

Py — Poy + ^gD\SfS\'ii,=F{y), (17) 

where notations of formula (7) are used: Toy is the kernel of linear functional Dxi,S\xi,=F{y) in Ty, 
Poy : Toy E is the orthogonal projector with respect to the entropic scalar product {\)F{y) (1^)- 
Vector Cg E T is proportional to the Riesz representation gy of linear functional Di^S\iif=F{y) in 
Ty with respect to the entropic scalar product: 

{9y I x)F(y) = {DiS,S\^=Fiy)){x) 

for every x e Ty, eg = gy/{gy \ gy)F{y)- 

Proof. Let y 7^ 0. Let us consider auxihary class of vector fields J onU with additional linear 

balance {Dxi,S)'qf=F{y)) (J) = 0. If such a vector field has Lyapunov function S, then ^ = F{y) is 
its equilibrium point: J{F{y)) = 0. The class of vector fields with this additional linear balance 
and Lyapunov function 5* is sufficiently rich and we can use the Propositions 1, 2 for dynamics 
on the auxiliary phase space 

{x e U\{D^S\s,=Fiy)){x - F{y)) = 0}. 

Hence, the restriction of Py on the hyperplane ker D^,S\^l,=F{y) is Poy Formula (17) gives the 
unique continuation of this projector on the whole E. □ 

1.3 Orthogonality of the thermodynamic projector and entropic gradient models 

In Euclidean spaces with given scalar product, we often identify the differential of a function 
f{x) with its gradient: in orthogonal coordinate system (grad/(a;))i = df{x)/dxi. However, 
when dealing with a more general setting, one can run into problems making sense out of such 
a definition. What to do, if there is no distinguished scalar product, no given orthogonality? 

For a given scalar product ( | ) the gradient grad^/(a;) of a function f{x) at a point x is such 
a vector g that {g\y) = D^fiy) for any vector y, where D^f is the differential of function / at 
a point X. The differential of function / is the linear functional that provides the best linear 
approximation near the given point. 



To transform a vector into a linear functional one needs a pairing, that means a bilinear form 
( I ). This pairing transforms vector g into linear functional {g\: {g\{x) = {g\x). Any twice 
differentiable function f{x) generates a field of pairings: at any point x there exists a second 
differential of /, a quadratic form (Dlf){Ax, Ax). For a convex function these forms are posi- 
tively defined, and we return to the concept of scalar product. Let us calculate a gradient of / 
using this scalar product. In coordinate representation 

d'^fdf df 

i ^ J J i J 



As we can see, this grad/(a;) is the Newtonian direction, and with this gradient the method of 
steepest descent transforms into the Newton's method of optimization. 

Entropy is the concave function and we defined the entropic scalar product through negative 
second differential of entropy (6). Let us define the gradient of entropy by means of this scalar 
product: (grad^5'|a;),f = {Dxi,S){x). The entropic gradient system is 

^ = ^(*)grad^5, (19) 



where (fi{'if) > is a positive kinetic multiplier. 

The system (19) is a representative of a family of model kinetic equations. One replaces com- 
plicated kinetic equations by model equations for simplicity. The main requirements to such 
models are: they should be as simple as possible and should not violate the basic physical laws. 
The most known model equation is the BGK model [39] for substitution of collision integral 
in the Boltzmann equation. There are different models for simplifying kinetics [40,41]. The 
entropic gradient models (19) possesses all the required properties (if the entropy Hessian is 
sufficiently simple). It was invented first for Lattice- Boltzmann kinetics [42]. In many cases it 
is more simple than the BGK model, because the gradient model is local in the sense that it 
uses only the entropy function and its derivatives at a current state, and it is not necessary to 
compute the equilibrium (or quasiequilibrium for quasiequilibrium models [15,40]. The entropic 
gradient model has an one-point relaxation spectrum, because the gradient vector field (19) has 
near an equilibrium ^^'^ an extremely simple linear approximation: d{A^f)/dt — —(fi{^'^'^)A^. 
It corresponds to a well-known fact that the Newton's method minimizes a positively defined 
quadratic form in one step. 

Direct calculation shows that the thermodynamic projector P (7) in a point onto the tangent 
space T can be rewritten as 



(20) 



where is the orthogonal projector onto T with respect the entropic scalar product, and the 
gradient grad^^* is sphtted onto tangent and orthogonal components: 

grad^-S = grad^^ll + grad^^^; grad^-S" = P^grad^-S; grad^-S^ = (1 - P^)grad^,S. 



From Eq. (20) it follows that two properties of an ansatz manifolds are equivalent: orthogonality 
of the thermodynamic projector and invariance of the manifold with respect to the entropic 
gradient system (19). 

Proposition 3. The thermodynamic projector for an ansatz manifold Q is orthogonal at any 
point ^ e Q i/ and only if grad^^S e T^{ft) at any point ^ e Q. □ 

It should be stressed that it should be possible to think of gradients as infinitesimal displace- 
ments of points ^. Usually there are some balances, at least the conservation of the total proba- 
bility, and the gradient should belong to a given subspacc of zero balances change. For example, 
for the classical Boltzmann-Gibbs-Shannon entropy S = — J ^(g)(ln^(g) — l)d'^q the entropic 
scalar product is (5'(q')|/(q'))* = f g{.<l)f{.'i) /^{.<l)d^q and grades' = — ^(g) ln(^(g)) + c(g), 
where function (vector) c{q) is orthogonal to a given subspace of zero balances. This function 
have to be founded from the conditions of zero balances for the gradient grad^-S. For example, 
if the only balance is the conservation of the total probability, / ^{q)d^q = 1, then for the 
classical Boltzmann-Gibbs-Shannon entropy S 

grad^5 = -^{q) (ln(*(g)) - j *(g') ln(*(g'))(i"g') ■ (21) 
For the KuUback-form entropy (i.e. for the negative free energy or the Massieu-Planck functions) 




the second differential and the entropic scalar product are the same, as for the classical 
Boltzmann-Gibbs-Shannon entropy, and 

g«d,5 = -*(,) (in ) - / *(^) In (^) d",') . (22) 

For more complicated system of balances, linear or non-linear, the system of linear equations 
for c{q) can also be written explicitly. 



1.4 Violation of transversality condition, singularity of thermodynamic projection and steps 
of relaxation 

The thermodynamic projector transforms the arbitrary vector field equipped with the given 
Lyapunov function into a vector field with the same Lyapunov function for a given ansatz 
manifold which is not tangent to the Lyapunov function levels. Sometimes it is useful to create 
an ansatz with violation of this transversality condition. The point of entropy maximum on 
this ansatz is not the equilibrium. The usual examples are: the non-correlated approximation 
^{xi, . . . ,Xn) = Uifixi), the Gaussian manifold, etc. For these manifolds the thermodynamic 
projector becomes singular near the point of entropy maximum ^* on the ansatz manifold. It 
is obvious from Eq. (20): in the neighborhood of it has the form 



P{J)=P\J) + 



grades'!! 



(grad^^* \J)m 



(grad^S'l'Igrad^S'll) 
a{^*) + 0{l), 



(23) 



where A^^ = ^ — ^* is the deviation of ^ from a{^*) — (grad^*5'-^| J)^* is the entropy 

production at the point a{^*) ^ 0, because the point of entropy maximum is not the 
equihbrium. In this case the projected system in the neighborhood of ^* reaches the point ^* 
at finite time t* as x/F^. The entropy difference AS" = S{^) - S{^*) = -^A^^l A^')vi>* + 
o((A^|A^)vt.) goes to zero as -a{'^*){t* - t) {t < t*). 

The singularity of projection has a transparent physical sense. The relaxation along the ansatz 
manifold to the point is not complete, because this point is not the equilibrium. This motion 
should be rated as a step of relaxation, and after it was completed, the next step should start. 
In this sense it is obvious that the motion to the point ^* along the ansatz manifold should 
take the finite time. The results of this step-by-step relaxation can represent the whole process 
(with smoothing [43], or without it [44]). The experience of such step-by-step computing of 
relaxation trajectories in the initial layer problem for the Boltzmann kinetics demonstrated its 
efficiency [43,44]. 

1.5 Thermodynamic projector, quasiequilibrium and entropy maximum 

The thermodynamic projector projects any vector field which satisfies the second law of ther- 
modynamics into the vector field which satisfies the second law too. Another projectors violate 
the second law. But what does it mean? Each projector onto tangent space to an ansatz 
manifold in a point ^ induces the fast-slow motion splitting: Fast motion is the motion parallel 
to kerP^ (on the affine subspace ^ -|- kerP^ in the neighborhood of ^), slow motion is the 
motion on the slow manifold and in the first order it is parallel to the tangent space in the 
point \E' (in the first order this slow manifold is the affine subspace ^ -|- imP^, 7^ — imP^), 
and velocity of the slow motion in point ^' belongs to image P^. 

If P$ is the thermodynamic projector, then ^ is the point of entropy maximum on the affine 
subspace of fast motion ^ + ker P^. It gives the solution to the problem 

S{x) max, X e * ker P^. (24) 

This is the most important property of thermodynamic projector. It was introduced in our paper 
[7] as a main thermodynamic condition for model reduction. Let us call it for nonequilibrium 
points ^ the property A: 



A. ker P^ C ker D^S. 



(25) 



If the projector P$ with the property A can be continued to the equilibrium point, as a 
smooth function of "if, then in this point ker P$ ± imP^. If this is valid for all systems (including 
systems with additional linear balances), then the following property B holds: 



B. (ker fl ker D^S) ± (imP^ f| ker D^S) . 



(26) 



Of course, orthogonality in formulae (25,26) is considered with respect to the entropic scalar 
product in point ^. 

The property A means that the value of entropy production persists for all nonequilibrium 
points. The sense of property B is: each point of the slow manifold can be made an equilibrium 
point (after the deformation of the system which leads to appearance on additional balance). 
And for equilibrium points the orthogonality condition (26) follows from the property A. 

If does not have the property A, then ^ is not the point of entropy maximum on the 

affinc subspace of fast motion \& + kerP,j,, so either the fast motion along this subspace does 
not leads to ^ (and, hence, the point ^ does not belong to slow manifold), or this motion 
violates the second law, and the entropy decreases. This is the violation of the second law 
of thermodynamics during the fast motion. If does not have the property A, then such a 
violation is expected for almost every system. 

On the other hand, if Pq, is not the thermodynamic projector, then there exists a thermodynamic 
vector field J, with non-thermodynamic projection: S is Lyapunov function for J (it increases), 
and is not Lyapunov function for P^^/{J) (it decreases in the neighborhood of ^). The difference 
between violation of the second law of thermodynamics in fast and slow motions for a projector 
without the property A is: for the fast motion this violation typically exists, for the slow 
(projected) motion there exist some thermodynamic systems with such a violation. On the 
other hand, the violation in slow motion is more important for applications, if we use the slow 
dynamics as an answer (and assume that the fast dynamics is relaxed). 

If P^ does not have the property B, then there exist systems with violation of the second law of 
thermodynamics in fast and slow motions. Here we can not claim that the second law violates 
for almost every system, but such systems exist. 

One particular case of thermodynamic projector is known during several decades. It is the 
quasiequilibrium projector on the tangent space of the quasiequilibrium (MaxEnt) manifold. 

Let a set of macroscopic (slow) variables be given: M = m(^'). The vector of macroscopic 
variables M is a continuous hnear function of microscopic variables ^. Let the ansatz manifold 
be the manifold of conditional entropy maximum: 



The solution of the problem (27) parametrized by values of the macroscopic variables M 
is the quasiequilibrium manifold. 

The projector on the tangent space to the quasiequilibrium manifold is: 



S'(^) max, m(^) = M. 



(27) 



-1 




(P)m*m)m^ 



m. 



(28) 



This formula was essentially obtained by Robertson [21] ^ . 



First of all, the thermodynamic projector (28) for the quasiequilibrium manifold (27) is the 
orthogonal projector with respect to the entropic scalar product (6). In this case both terms 
in the thermodynamic projector (7) are orthogonal projectors with respect to the entropic 
scalar product (6). The first term, Pq, is orthogonal projector by construction. For the second 
term, eg{D^S), it means that the Riesz representation of the linear functional D^S in the 
whole space E with respect to the entropic scalar product belongs to the tangent space of 
the quasiequilibrium manifold. This Riesz representation is the gradient of S with respect to 
( I The following Proposition gives simple and important condition of orthogonality of the 
thermodynamic projector (7). Let Q be an ansatz manifold, and let V be some quasiequilibrium 
manifold, E QOV , T^, he the tangent space to the ansatz manifold Q in the point \E'. 
Suppose that there exists a neighborhood of "if where V Q fl. We use the notation grad^^ 
for the Riesz representation of the linear functional D-qiS in the entropic scalar product ( | 
{grad^S\f)^ = {D^S){f)forfeE. 

Proposition 4. Under given assumptions, grad^^ G Txj,, and the thermodynamic projector 
is the orthogonal projector onto with respect to the entropic scalar product (6). H 

So, if a point \& on the ansatz manifold Q belongs to some quasiequilibrium submanifold V C 
then the thermodynamic projector in this point is simply the orthogonal projector with respect 
to the entropic scalar product (6). 

Proposition 4 is useful in the following situation. Let the quasiequilibrium approximation be 
more or less satisfactory, but the "relevant degrees of freedom" depend on the current state of 
the system. It means that for some changes of the state we should change the list of relevant 
macroscopic variables (moments of distribution function for generation the quasiequilibrium). 
Sometimes it can be described as presence of hidden degrees of freedom, which are not moments. 
In these cases the manifold of reduced description should be extended. We have a family of 
systems of moments = mai"^), and a family of corresponding quasiequilibrium manifolds 
flee'- The manifold consist of solutions of optimization problem 5'(\[') max, m„(^) = M for 
given a and all admissible values for M. To create a manifold of reduced description it is possible 

^ In his dissertation [21] B. Robertson has studied "the equation of motion for the generalized canon- 
ical density operator". The generahzed canonical density renders entropy a maximum for given sta- 
tistical expectations of the thermodynamic coordinates. He started from the Liouville equation for 
a general quantum system. The first main result of Robertson's paper is the explicit expression for 
splitting of the motion onto two components: projection of the motion onto generalized canonical 
density and the motion in the kernel of this projection. The obtained projector operator is a specific 
particular case of the quasiequilibrium projector (28). The second result is exclusion of the motion in 
the kernel of quasiequilibrium projector from the dynamic equation. This operation is similar to the 
Zwanzig formalism [45] . It leads to the integro-differential equation with delay in time for the general- 
ized canonical density. The quasiequilibrium projector (28) is more general than the projector obtained 
by Robertson [21] in the following sense: It is derived for any functional S with non-degenerate second 
differential D^S, for manifold of condition maxima of S and for any (nonlinear) differential equation. 
B. Robertson emphasized that this operator is non-Hcrmitian with respect to standard scalar prod- 
uct and in this sense is not a projector at all. Nevertheless it is self-adjoint (and, hence, orthogonal), 
but with respect to another (entropic) scalar product. The general thermodynamic projector (7) acts 
with an arbitrary ansatz manifolds and in that sense is much more general. The motion in transversal 
direction will be discussed below together with post-processing algorithms. 



to join all the moments Ma in one family, and construct the corresponding quasiequilibrium 
manifold. Points on this manifold are parametrized by the family of moments values {M^} 
for all possible a. It leads to a huge increase of the quasiequilibrium manifold. Another way 
to extension of the quasiequlibrium manifold is a union of all the manifolds for all a. In 
accordance with the Proposition 4, the thermodynamic projector for this union is simply the 
orthogonal projector with respect to the entropic scalar product. This kind of manifolds gives 
a closest generalization of the quasiequilibrium manifolds. An example of such a construction 
will be described below. 

Quasiequilibrium approximation became very popular after works of Jaynes [1] ^ . Due to Eq. 

(24) the thermodynamic projector gives the presentation of almost arbitrary ansatz as the 
quasiequilibrium manifold. This property opens the natural field for applications of thermody- 
namic projector: construction of Galerkin approximations with thermodynamic properties. 

Of course, there is a "law of the difficulty conservation" : for the quasiequilibrium with the mo- 
ment parameterization the slow manifold is usually not explicitly given, and it can be difficult to 
calculate it. Thermodynamic projector completely eliminates this difficulty: we can use almost 
any manifold as appropriate ansatz now. On the other side, on the quasiequilibrium manifold 
with the moment parameterization (if it is found) it is easy to find the dynamics: simply write 
M = m{J). The building of the thermodynamic projector may require some efforts. Finally, if 
the classical quasiequilibrium manifold is found, then it is easy to find the projection of any 
distributions \E' on the quasiequilibrium manifold: ^ ^ m(\E') i— > ^m('i')- requires just a cal- 
culation of the moments m(^). The preimage of the point ^|^(^) is a set (an affine manifold) of 
distributions {\E'|m(\E' — \E'^(^)) = 0}, and ^E'^(-,j,) is the point of entropy maximum on this set. It 
is possible, but not so easy, to construct such a projector of some neighborhood of the manifold 
Q, onto for general thermodynamic projector P$ too: for a point $ from this neighborhood 



A point ^ G r2 is the point of entropy maximum on the preimage of ^, i.e. on the affine manifold 
{$|P^($ — ^') = 0}. It is necessary to emphasize that the map (29) can be defined only in a 
neighborhood of the manifold Q, but not in the whole space, because some of affine subspaces 

^ Prom time to time it is discussed in the literature, who was the first to introduce the quasiequilibrium 
approximations, and how to interpret them. At least a part of the discussion is due to a different role 
the quasiequiUbrium plays in the entropy-conserving and the dissipative dynamics. The very first use of 
the entropy maximization dates back to the classical work of G. W. Gibbs [22], but it was first claimed 
for a principle by E. T. Jaynes [1]. Probably the first explicit and systematic use of quasiequilibria 
to derive dissipation from entropy-conserving systems is due to the works of D. N. Zubarev. Recent 
detailed exposition is given in [2]. For dissipative systems, the use of the quasiequilibrium to reduce 
description can be traced to the works of H. Grad on the Boltzmann equation [23]. The viewpoint of the 
present authors was influenced by the papers by L. I. Rozonoer and co-workers, in particular, [3,4,24]. 
A detailed exposition of the quasiequilibrium approximation for Markov chains is given in the book [25] 
(Chapter 3, Quasiequilibrium and entropy maximum, pp. 92-122), and for the BBGKY hierarchy in 
the paper [5]. We have applied maximum entropy principle to the description the universal dependence 
the 3-particle distribution function on the 2-particlc distribution function F2 in classical systems 
with binary interactions [26] . A general discussion of the maximum entropy principle with applications 
to dissipative kinetics is given in the review [27]. The methods for corrections the quasiequilibrium 
approximations are developed in [7,8,34,33] 




(29) 



{$|P^($ — ^) = 0} for different \1/ G can intersect. Let us introduce a special denotation for 
projection of some neighborhood of the manifold Q onto associated with the thermodynamic 
projector (29): : $ i— > ^P. The preimage of a point G O is: 



(or, strictly speaking, a vicinity of in this affine manifold). Differential of the operator Pq at 
a point ^ e Q from the manifold ft is simply the projector P^: 



Generally, differential Pn at a point ^ has not so simple form, if ^ does not belong Q,. 

The "global extension" Pf^ of a field of "infinitesimal" projectors Pf (/ G Q) is needed for 
discussion of projector operators technique, memory functions and short memory approximation 
below. 

Is it necessary to use the thermodynamic projector everywhere? The persistence of dissipation 
is necessary, because the violation of the second law may lead to strange non-physical effects. 
If one creates a very accurate method for solution of initial equation (1), then it may be 
possible to expect that the persistence of dissipation will hold without additional efforts. But 
this situation yet have not appeared. All methods of model reduction need a special tool to 
control the persistence of dissipation. 

In order to summarize, let us give three reasons to use the thermodynamic projector: 

(1) It guarantees the persistence of dissipation: all the thermodynamic processes which should 
product the entropy conserve this property after projecting, moreover, not only the sign 
of dissipation conserves, but the value of entropy production and the reciprocity relations 
too; 

(2) The coefficients (and, more generally speaking, the right hand part) of kinetic equations 
are known significantly worse then the thermodynamic functionals, so, the universality 
of the thermodynamic projector (it depends only on thermodynamic data) makes the 
thermodynamic properties of projected system as reliable, as for the initial system; 

(3) It is easy (much more easy than spectral projector, for example). 



2 Post-processing, memory and natural projector 

2.1 How to evaluate the ansatz? 

Thermodynamic projector transforms almost arbitrary ansatz into thermodynamically consis- 
tent model. So, the simplest criteria of quality of an ansatz (entropy grows, reciprocity relations, 
etc.) are satisfied by the construction of the projector. How to evaluate the ansatz now? 



p-i^ = * + ker Pv 



(30) 




(31) 



First of all, we can estimate the defect of invariance A = J{^) — P-^{J{^))- If A is not small 



(in comparison with the typical value of J), then the ansatz should be improved (for details 
see, for example, [28,46]). It is possible to use A for error estimation and correction of an 
ansatz after solution of projected equations too (it is so-called post-processing [47,16]). Let 
^°(t), {t E [0,T]) be the solution of projected equations d'^{t)/dt = P^(J(*)), and A(t) = 
J{^\t)) - P^o(t)( J(*0(t))). Then the following formula 

t 

^,\t) = ^°(t) + J A{T)dT (32) 



gives the Picard iteration for solution of the initial kinetic equation d'^{t)/dt = J(\l'), with 
initial approximation ^'°(t). The integral in the right hand side of equation (32) gives the 
estimation of the deviation the ansatz solution ^°(t) from the true solution as well, as the 
correction for this ansatz solution. For a better estimation we can take into account not only 
A(i), but the linear part of the vector field J(^) near ^°(i), and use different approximations of 
this linear part [16]. The following representation gives us one of the simplest approximations: 
^l(t) = ^O(t) +5^(t); 



where A(t) = J(*°(t)) - P*o(t)(J(^°(t))), (P'J)vto(t) is the differential of J(^(t)) in the point 
^°(t), ( I )^o(t) is the entropic scalar product (6) in the point \l'°(t). 

The solution of equation (33) is 




S-^{t) = / exp / k{9)d9 A(r)dT, (34) 



where 

(A(i)[(DJ)^o(i)A(i))^o(,) 



kit) 



The right hand side of equation (34) improves the simplest Picard iteration (32) and gives both 
the estimation of the error of the ansatz, and the correction for the solution ^°(i). 

The projection of A on the slow motion ansatz is zero, hence, for post-processing analysis of 
the slow motion, the estimation (34) should be supplemented by one more Picard iteration: 

t 

6^,i{t) = P^o^t)S^{t) + J P^o(,)((L'J)^o(,))5*(T)ciT, (35) 



where S'^it) is calculated by formula (34). 



2.2 Short memory and natural projector 



At the middle of XX century S. Nakajima (1958), R. Zwanzig (1960), and H. Mori (1965) 
discovered a new approach to model reduction in statistical physics: the method of projection 
operators. (Relevant bibliography and detailed presentation of this technic can be found in 
two books [48,49].) In this section we contrast our approach with the Nakajima-Zwanzig-Mori 
theory of projection operators. This theory is based upon two technical steps: (i) a projection 
technique for creation exact integro-differential equations that describe dynamics of "relevant" 
variables for given initial conditions, (ii) and various Marcovian, short memory, adiabatic, or 
other assumptions of this type that allow us to simplify the exact integro-differential equations. 
Without such a simplification the theory is simply equivalent to the initial detailed microscopic 
dynamics. 

The projection operators approach (it is more adequate to call it "the memory function ap- 
proach" [48]) deals with linear equations of microscopic description: Liouville equation (or 
generalized quantum Liouville equation). The thermodynamic projector developed in this pa- 
per and a series of previous works [7,8,15,43] can be applied to any system with entropy, i.e. 
to a system with a specified function (functional) whose time derivative should be preserved in 
model reduction. Of course, it can be applied to the systems considered in the memory function 
approach to project the initial equations onto the manifold of relevant distribution functions. 
Moreover, the particular case of the thermodynamic projector, namely the quasiequilibrium pro- 
jector, was developed for this purpose by B. Robertson in the context of Nakajima - Zwanzig 
approach [21]. 

In this paper we have discussed only the simple infinitesimal projection of the vector field 
onto the tangent space to ansatz manifold, but it is possible to develop a hierarchy of short- 
memory approximations even for general nonlinear equations and an arbitrary ansatz manifold 
[28,29,30,31,32,33,34]. This approach joins ideas of Ehrenfests on coarse-graining [35], methods 
of projection operators, and methods of invariant manifold [7,8,15]. The essence of this approach 
can be formulated very simply: we turn from infinitesimal projection of vector fields to "natural 
projection" of segments of trajectories. 

Let us consider a dynamical system (1) /dt = J(^E'), an ansatz manifold Q, a field of pro- 
jectors on Q: Pq, : E ^ for \E' G and a global extension (29), (30) of this field of 
infinitesimal projectors. In this construction the field of projectors is arbitrary, and thermo- 
dynamic condition will be necessary only for estimation of the entropy production (see the next 
subsection). Let be the shift in time t due to the dynamical system (1) (the phase flow). We 
are looking for a phase flow @t on D, that should be a coarse-grained dynamical system in a 
short memory approximation. The matching equation for the short memory approximation is 



0^(*) = Pn(T^(*)) for all * e Q, 



(36) 



where r > is the time of memory (it may be a function of ^: r = t(^)). 



The phase flow @t on Q. is generated by a vector field on fl: 



d^ 
'dt 



T(*) 



d&ri"^) 

dr 



T=0 



(37) 



For the short memory it may be natural to seek a vector field T(\E') on the ansatz manifold Q 
in a form of Taylor series in powers of r: T(^) = To(^) + rTi(^) + . . . . Let us expand the 
right hand side of the matching equation (36) into Taylor series in powers of r. In zero order 
we get an equality ^ = ^. In first order we obtain an expected trivial "infinitesimal" result 
To(^) = PxSf{J{'^)). First non-trivial result is an expression for Ti(^): 

Ti(*) = ^{P*[(L'* J(*)) J(*)] - [^^(P^ J(*))](P^ J(*))} + 

lp|PoW](JW,J(*)). 

In this order we obtain the first short-memory approximation: 

^{p^[(D^j(^))j(^)] - [D^{p^j{^mp^j{^))} + 

If kerPij, does not depend of then it is possible to choose such a coordinate system on fl 
where hnear operator P^ does not depend of ^. Then the last term in Eqs. (38), (39) vanishes. 
It is the case of quasiequilibrium manifolds, for example [28,29]. 

Various physical examples of application of these formulae with quasiequilibrium manifolds are 
presented in refs. [28,29,30,31,34]. 

The theory of short memory and coarse-graining in the form given by Eqs. (36), (38), (39) has 
one free parameter: the memory time t(^). The next step is development of the theory without 
such free parameters [32,33]. 

The first attempt to formalize the short memory approximation and coarse-graining on the 

base of the matching equation (36) was made by Lewis [36], but he expanded only the right 
hand side of Eq. (36), and the result was not a solution of this equation. Very recently the short 
memory approximation becomes more popular [37,38]. 



2.3 The theorem about entropy overproduction in the short memory approximation 

The short memory approximation (39) has one important property: it increase the entropy 
production for the thermodynamic projectors P$: if for any vector field the field of projectors 
P^ preserves dissipation, then for any vector field the short memory approximation increases 
dissipation (and it strictly increases dissipation, if the vector field is not tangent to ansatz 
manifold fl). 

This theorem about entropy overproduction can be formulate as a expression for entropy pro- 
duction. 



(38) 




Theorem 2. Let P^, be the field of thermodynamic projectors. Then, due to the short memory 
approximation (39) for ^ e O 



dS 
'dt 



<7oW + ^<7i(*) + ^(A(*)|A(*))^, 



(40) 



where A is defect of invariance: A = ./(^) — -P*(</(^)), 



(7o(*) 



dS{T,{^)) 



f7l(*) 



dr 
dr^ 



T=0 



T=0 



(L'^5(*))[(L'*J(*))(J(*))] - (J(*)| J(*))^. 



(41) 



(f7o(^) is entropy production due to initial system at a point ^.) The geometrical proof of this 
formula (40) is simple. The matching condition (36) represents a motion in according to a short 
memory approximation as two steps: (i) the motion along trajectories of initial system during 
time r, and (ii) the projection onto manifold Q by means of the operator Pq (29), (30). The 
entropy increment on the first step is 



To calculate the entropy increment on the projection step with accuracy we need to calculate 
the motion with accuracy only, because the point ^' G ^2 is the point of entropy maximum 
on its preimage P^^(\E') (here it is crucial that is the field of thermodynamic projectors with 
the property A (25)). In the first order T^(^') - Pq(T^(*)) = tA(^') and the last term in Eq. 
(40) is just the Taylor formula for S of the second order. □ 

First two terms in Eq. (40) give the average entropy production by the initial system in time r 
(up to the second order in r). The third term is always non-negative, and is zero only for zero 
defect of invariance. In this sense Theorem 2 is the theorem about entropy overproduction. The 
following Corollary gives an obvious, but physically important consequence of this theorem. 

Corollary 3. Let the initial system (1) be conservative: dS/dt = (D^S'(^))( J(^')) = 0. Then 
for the short memory approximation (39) entropy production is non-negative: 



and dS/dt = if and only if the vector field J(^') is tangent to ansatz manifold. □ 

The short-memory approximation equipped by the thermodynamic projector gives us the sim- 
plest way to introduce dissipation into a conservative system. 




dS 
'dt 



^(A(^)|A(^))^>0, 



(42) 



3 The art of ansatz: Multi-peEik polyhedrons in kinetic systems with instabilities 

3.1 Two-peak approximations 

The thermodynamic projector guarantees the thermodynamic consistence of ansatz, and post- 
processing gives both the estimations of the error and correction for the solution. So, the 
main requirement to an ansatz now is: to capture the essence of the phenomenon. This is the 
art of ansatz. Is it possible to formalize this art? In this subsection we discuss two special 
ansatz which are known for several decades and mysteriously are at the same time simplest 
and reliable nonperturbative approximations in the domains of their application. The requested 
formalization seems to be possible, at least, partially. 



3.1.1 Tamm-Mott- Smith approximation for kinetics of shock waves 

Shock waves in gas flows are important from practical, as well, as from theoretical points of 
view. Some integral parameters of the shock wave front can be obtained by gas dynamics equa- 
tions with additional thermodynamic relations, for weak shocks the hydrodynamic approach 
can give the shock front structure too [50] . For strong shocks it is necessary to use the kinetic 
representation, for rarefied gases the Boltzmann kinetic equation gives the framework for study- 
ing the structure of strong shocks [51]. This equation describes the dynamics of the one-particle 
distribution function f{v,x), where v is the vector of particle velocity, and x is the particle 
position in space. One of the common ways to use the Boltzmann equation in physics away 
from exact solutions and perturbation expansions consists of three steps: 

(1) Construction of a specific ansatz for the distribution function for a given physical problem; 

(2) Projection of the Boltzmann equation on the ansatz; 

(3) Estimation and correction of the ansatz (optional). 

The first and, at the same time, the most successful ansatz for the distribution function in the 
shock layer was invented in the middle of the XX century. It is the bimodal Tamm-Mott-Smith 
approximation (see, for example, the book [51]): 



where z is the space coordinate in the direction of the shock wave motion, f±{v) are the 
downstream and the upstream Maxwellian distributions, respectively. 

Direct molecular dynamics simulation for the Lennard-Jones gas shows good quantitative agree- 
ment of the Tamm-Mott-Smith ansatz (43) with the simulated velocity distribution functions 
in the shock fronts for a wide range of Mach number (between 1 and 8.19) [53]. For different 
points in the shock front the bimodal approximation (43) of the simulated velocity distribution 
function has appropriate accuracy, but the question about approximation of the a±{z) remained 
open in the paper [53] , because the authors of this paper had "no way to decide which of the 
equations proposed in the literature yields better results" . 




(43) 



The thermodynamic projector gives the unique thermodynamically consistent equation for the 
Tamm-Mott-Smith approximation (43) [7] (in our paper [7] we have used only the property 
A, but for this one-dimensional ansatz it was sufficient for uniqueness of the projector). These 
equations have a simple form for the variables: 

n(z) = j fTMs(v,z)d^v; s{z) = -/cb j husiv, z) In f tms(v, z)d^ v. 

The particles density n{z) is linear function of a±{z). The entropy density s is a more com- 
plicated function of a±, but there are simple expansions both for weak and for strong shocks 
[7,52]. 

The equations for n{z,t), s{z,t) in the Tamm-Mott-Smith approximation have the form: 

ds djs dn djn „ 



where 

js{z) = -kB J vjTMsi'V,z)lnfTMsiv,z)d^V, jn{z) = j vjTMsiv,z)d^V, 

and a is the Boltzmann density of entropy production for the TMS distribution (43) : 

(7 = -/cb j J{fTMs)iv,z)lnfTMsiv,z)d^v, 
where J{f) is the Boltzmann collision integral. 

Equations (44) were first introduced by M. Lampis [52] in the ad hoc manner. Direct numerical 
simulation demonstrated that all other known equations for the Tamm-Mott-Smith ansatz 
violate the second law [54] . 



3.1.2 Langer-Bar-on-Miller approximation for spinodal decomposition 

The spinodal decomposition is the initial stage of a phase separation in thermodynamically 
unstable solid solution. It requires no activation energy (unstable does not mean metastable). 
The order parameter is the composition variable (concentration c of one of components, for 
example). Hence, the rate of the spinodal decomposition is limited by diffusion processes. 

The process of spinodal decomposition was described quantitatively in the paper [55]. This 
model consists of two coupled equations: for the single-point distribution function of fluctua- 
tions, and for the pair correlation function. The fluctuation u{r) = c{r) — Cq is deviation of 
the concentration c from the average concentration cq. The time evolution of the single-point 
distribution density of fluctuation, p\{u) is described by the one-dimensional Fokker-Planck 
equation: 



where 6 is a constant, F{u) is a mean-fleld free energy which depends on the value of on the 
whole function pi (because F{u) includes some averages in the mean fleld approximation), and 



on the two-point correlation function (because it depends on average square of Vw(r)). The 
assumption 

P2[u{r),u{ro)] = pi[u{r)]pi[u{ro)]{l +-f{\r- ro\)u{r)u{ro)} (46) 



allows to truncate the infinite chain of equations for all correlation functions, and to write the 
equation for the two-point correlation function. Details are presented in the paper [55] . 

The mean-field free energy function F{u) is non- stationary and may be non-convex. Thus, the 
one-peak representations for pi{u) are far from a physical sense, but it is possible to try the 
two-peak ansatz: 

pi{u) = aiGa{u - qi) + a2Ga{u + ^2), (47) 



where Oi = (^2/ {^1 + ^2), 02 = ^1/(^1+^2) (because obvious normalization conditions), and Gfj{u) 
is the Gaussian distribution: Ga{u) — exp (— ^) • 

The systematic use of this two-peak ansatz (47) allowed to get the satisfactory quantitative 
description for some features of spinodal decomposition. The authors of the paper [55] men- 
tioned that the present computational scheme does appear to be accurate enough to justify 
its use in the study of realistic metallurgical systems. Instead of thermodynamic projector 
which was not known in 1975, they used the projection onto the first three non-trivial moments 

The Langer-Bar-on-Miller bimodal ansatz has a long history of criticizing and comparison with 
experiments and other calculations. During 10 years after this publication there were some at- 
tempts to criticize and improve this theory. Nevertheless, at 1985 this theory was called "the 
most successful "early-time" theory yet available" [56] . In this paper the nonlinear Langer-Bar- 
on-Miller theory was again criticized as non-systematic, "since there is no smallness param- 
eter" ^ . Nevertheless, 20 years of various attempts to improve this theory of bimodal ansatz 
were resumed in the paper [57]: "There have been many theories that attempt to incorporate 
nonlinear effects in the description of the spinodal decomposition process. The most successful 
of these was devised by Langer, Baron, and Miller" . This situation reminds the situation with 
TMS ansatz for shock waves. 

More recently, applications of Monte Carlo methods to the self-consistent calculation of a 
Ginzburg-Landau free energy functional for Lennard-Jones systems in three dimensions are 

discussed [58]. It was demonstrated that the parameters in the coarse-grained free energy can 
be extracted from a multivariate distribution of energies and particle densities. Histograms of 
calculated unimodal and bimodal density distributions are presented. 



° This explicit belief in small parameters and Taylor expansion remains widespread in spite of many 
well-known computational algorithms that use no explicit small parameters both in computational 
mathematics and mathematical physics. It seems strange after success of famous KAM-theory, for 
example. 



3.2 Multi-peak ansatz and mean-field theory of molecular individualism 



3.2.1 Two-peak approximation for polymer stretching in flow and explosion of the Gaussian 
manifold 

We shall consider the simplest case of dilute polymer solutions represented by dumbbell models. 
The dumbbell model reflects the two features of real-world macromolecules to be orientable 
and stretchable by a flowing solvent [61] . 

Let us consider the simplest onc-dimcnsional kinetic equation for the configuration distribution 
function ^'(g, t), where q is the reduced vector connecting the beads of the dumbbell. This 
equation is slightly different from the usual Fokker-Planck equation. It is nonlinear, because of 
the dependence of potential energy U on the moment Af2[^] = / q^'^{q)dq. This dependence 
allows us to get the exact quasiequilibrium equations on M2, but this equations are not solving 
the problem: this quasiequilibrium manifold may become unstable when the flow is present [20]. 
Here is this model: 

dt-^ = -d,{a{t)q^} + ]-dl^. (48) 



Here 

a{t)^K{t)-\f{M^{t)), (49) 

K{t) is the given time-independent velocity gradient, t is the reduced time, and the function —fq 
is the reduced spring force. Function / may depend on the second moment of the distribution 
function M2 = J q^'^{q,t)dq. In particular, the case / = 1 corresponds to the linear Hookean 
spring, while / = [1 — M2{t)/b]~^ corresponds to the self-consistent finite extension nonlinear 
elastic spring (the FENE-P model, first introduced in [62]). The second moment M2 occurs 
in the FENE-P force / as the result of the pre-averaging approximation to the original FENE 
model (with nonlinear spring force / = [l—q'^/b]~^). The parameter b changes the characteristics 
of the force law from Hookean at small extensions to a confining force for — ^ b. Parameter 
b is roughly equal to the number of monomer units represented by the dumbell and should 
therefore be a large number. In the limit 6 — > 00, the Hookean spring is recovered. Recently, it 
has been demonstrated that FENE-P model appears as first approximation within a systematic 
self-confident expansion of nonhnear forces [28]. 

Equation (48) describes an ensemble of non-interacting dumbells subject to a pseudo-elongational 
flow with fixed kinematics. As is well known, the Gaussian distribution function. 



2Mo 



(50) 



solves equation (48) provided the second moment M2 satisfles 

^^l + 2a{t)M2. (51) 
at 



Solution (50) and (51) is the valid macroscopic description if all other solutions of the equa- 
tion (48) are rapidly attracted to the family of Gaussian distributions (50). In other words [8], 
the special solution (50) and (51) is the macroscopic description if equation (50) is the stable 
invariant manifold of the kinetic equation (48). If not, then the Gaussian solution is just a mem- 
ber of the family of solutions, and equation (51) has no meaning of the macroscopic equation. 
Thus, the complete answer to the question of validity of the equation (51) as the macroscopic 
equation requires a study of dynamics in the neighborhood of the manifold (50). Because of 
the simplicity of the model (48), this is possible to a satisfactory level even for M2-dependent 
spring forces. 

In the paper [20] it was shown, that there is a possibility of "explosion" of the Gaussian manifold: 
with the small initial deviation from it, the solutions of the equation (48) are very fast going 
far from, and then slowly come back to the stationary point which is located on the Gaussian 
manifold. The distribution function ^ is stretched fast, but looses the Gaussian form, and after 
that the Gaussian form recovers slowly with the new value of M2. Let us describe briefly the 
results of [20]. 

Let = J q^'^'^dq denote the even moments (odd moments vanish by symmetry). We consider 
deviations //2n — M2n — M^, where = / q^^^'^dq are moments of the Gaussian distribution 
function (50). Let ^{q^to) be the initial condition to the Eq. (48) at time t — to. Introducing 
functions. 



P2n{t,to) = exp 



An J a{t')dt' 

. to 



(52) 



where t >to, and 2n > 4, the exact time evolution of the deviations H2n for 2n > 4 reads 

Hi{t) ^Pi{t,tQ)iJLi{tQ), (53) 



and 



IJ'2n{t) = 



H2n{to) + 2n(4n - I) j H2n-2{t')p2n{t' ,to)dt' 
to 



P2n{t,to), 



(54) 



for 2n > 6. Equations (52), (53) and (54) describe evolution near the Gaussian solution for 
arbitrary initial condition ^(g, io)- Notice that explicit evaluation of the integral in the Eq. 
(52) requires solution to the moment equation (51) which is not available in the analytical form 
for the FENE-P model. 

It is straightforward to conclude that any solution with a non- Gaussian initial condition con- 
verges to the Gaussian solution asymptotically as i — > 00 if 



hm J a{t')dt' < 0. 

to 



(55) 



However, even if this asymptotic condition is met, deviations from the Gaussian solution may 
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Fig. 1. Deviations of reduced moments from the Gaussian solution as a function of reduced time t 
in pseudo-elongation flow for the FENE-P model. Upper part: Reduced second moment X = M2/6. 
Lower part: Reduced deviation of fourth moment from Gaussian solution Y = —fj,\^'^/b. Solid: k = 2, 
dash-dot: k = 1, dash: k = 0.75, long dash: k = 0.5. (The figure from the paper [20], computed by P. 
Ilg.) 

survive for considerable finite times. For example, if for some finite time T, the integral in the 
Eq. (52) is estimated as /^^^ a{t')dt' > ait—to), a > 0,t < T, then the Gaussian solution becomes 
exponentially unstable during this time interval. If this is the case, the moment equation (51) 
cannot be regarded as the macroscopic equation. Let us consider specific examples. 

For the Hookean spring (/ = 1) under a constant elongation [k, = const), the Gaussian solution 
is exponentially stable for k, < 0.5, and it becomes exponentially unstable for k, > 0.5. The 
exponential instability in this case is accompanied by the well known breakdown of the solution 
to the Eq. (51) due to infinite stretching of the dumbbell. The situation is much more interesting 
for the FENE-P model because this nonfinear spring force does not allow the infinite stretching 
of the dumbbell. 

Eqs. (51) and (53) were integrated by the 5-th order Runge-Kutta method with adaptive time 
step. The FENE-P parameter b was set equal to 50. The initial condition was \l/(g, 0) = C(l — 
g^/6)^/^, where C is the normalization (the equilibrium of the FENE model, notoriously close 
to the FENE-P equilibrium [63]). For this initial condition, in particular, ^^{O) = — 66^/[(6 -|- 
3)^(6+5)] which is about 4% of the value of M4 in the Gaussian equilibrium for b — 50. In Fig. 1 
we demonstrate deviation //4(t) as a function of time for several values of the fiow. Function 
M2{t) is also given for comparison. For small enough k we find an adiabatic regime, that is 
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H4 relaxes exponentially to zero. For stronger flows, we observe an initial fast runaway from 
the invariant manifold with \fi4^\ growing over three orders of magnitude compared to its initial 
value. After the maximum deviation has been reached, relaxes to zero. This relaxation is 
exponential as soon as the solution to Eq. (51) approaches the steady state. However, the time 
constant for this exponential relaxation |ci;oo| is very small. Specifically, for large k, 

= lim a{t) = + 0{k-^). (56) 

Thus, the steady state solution is unique and Gaussian but the stronger is the fiow, the larger 
is the initial runaway from the Gaussian solution, while the return to it thereafter becomes 
flow- independent. Our observation demonstrates that, though the stability condition (55) is 
met, significant deviations from the Gaussian solution persist over the times when the solution 
of Eq. (51) is already reasonably close to the stationary state. If we accept the usually quoted 
physically reasonable minimal value of parameter b of the order 20 then the minimal relaxation 
time is of order 40 in the reduced time units of Fig. 1. We should also stress that the two 
limits, K — > oo and b — > oo, are not commutative, thus it is not surprising that the estimation 
(56) does not reduce to the above mentioned Hookean result as 6 — > oo. Finally, peculiarities 
of convergence to the Gaussian solution are even furthered if we consider more complicated 
(in particular, oscillating) fiows K,{t). Further numerical experiments are presented in [64]. The 
statistics of FENE-P solutions with random strains was studied recently by J.-L. Thiffeault [65] 

In accordance with [59] the ansatz for can be suggested in the following form: 

*-({.,c},«) = ^(e-'S#+e-'^S^). (57) 

Natural inner coordinates on this manifold are a and Note, that now ^ M2. The value 
is a dispersion of one of the Gaussian summands in (57), 

To build the thermodynamic projector on the manifold (57), the thermodynamic Lyapunov 
function is necessary. It is necessary to emphasize, that equations (48) are nonlinear. For such 
equations, the arbitrarity in the choice of the thermodynamic Lyapunov function is much smaller 
than for the linear Fokker Planck equation. Nevertheless, such a function exists. It is the free 
energy 

F ^U(M2[^]) -TS[% (58) 
where 

S[^] = - J ^{\n-^-l)dq, 

U (M2[^]) is the potential energy in the mean field approximation, T is the temperature (further 
we assume that T = 1). 



Note, that KuUback-form entropy Sk — — J In (^j also has the form Sk — —F/T: 



= exp(-C/), 
Sk[^ = -{U)- J ^In-^dq. 

If U{M2[^]) in the mean field approximation is the convex function of M2, then the free energy 
(58) is the convex functional too. 

For the FENE-P model U = - ln[l - M2/6]. 

In accordance to the thermodynamics the vector I of flow of ^ must be proportional to the 
gradient of the corresponding chemical potential /i: 



(59) 



where = 4^, 5 > 0. From the equation (58) it follows, that 



5^ + In * 



I = -S(*) 



dM2 ' ^ 



If we suppose here B — then we get 



= diVg/ = L' 

dt ^ dM' 



I =-D 

dU{M2 



D 



(60) 



(61) 



When D — 1 this equations coincide with (48) in the absence of the flow: due to equation (61) 
dF/dt < 0. 

Let us construct the thermodynamic projector with the help of the thermodynamic Lyapunov 
function F (58). Corresponding entropic scalar product in the point ^ has the form 



{f\9h 



d^U 



dM^ 



M2=M2[*] 



/ q'mdq ■ I q^g{q)dq 



+ 



f{q)9{q) 

^>{q) 



dq 



(62) 



During the investigation of the ansatz (57) the scalar product (62), constructed for the corre- 
sponding point of the Gaussian manifold with M2 = (t^, will be used. It will let us to investigate 
the neighborhood of the Gaussian manifold (and to get all the results in the analytical form): 



dMi 



M2=0-2 



J q^f{q)dq- J q^g{q)dq + aV2n J el' f{q)g{q)dq 



(63) 



Also we will need to know the functional DF in the point of Gaussian manifold: 



M2=<t2 



(64) 



(with the condition / f{q)dq = 0). The point 



dU{M2 



dMo 
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M2=C72 

corresponds to the equilibrium. 

The tangent space to the manifold (57) is spanned by the vectors 
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(65) 



The Gaussian entropy (free energy) production in the directions and (64) has a very 
simple form: 



DF„2{f,) = DFAfa) 



dU{M2 



dMo 



Ma =0-2 



2(72" 



(66) 



The linear subspace ker DF^2 in lin{fer, f^} is spanned by the vector — f^r- 



Let us have the given vector field /dt = J(^l') in the point \E'({(T, <j}). We need to build the 
projection of J onto the tangent space T^.^^ in the point ^'({(T, <j}): 



P*J( J) = cpj, + ipj,. 



(67) 



This equation means, that the equations for and q'^ will have the form 
da^ dq'' 



(68) 



Projection ((^^r, 9??) can be found from the following two equations: 



Va + V,^ J q^J{^){q)dq; 

Ma + <pMfa - h)a- = (^(*)|/. " A>.2, 



(69) 




Fig. 2. Phase trajectories for the two-peak approximation, FENE-P model. The vertical axis {(; = 0) 
corresponds to the Gaussian manifold. The triangle with a(M2) > is the domain of exponential 
instability. 

where {f\g)a'^ = {J{'^)\fa — /?)(t2, (62). First equation of (69) means, that the time deriva- 
tive dM2/dt is the same for the initial and the reduced equations. Due to the formula for the 
dissipation of the free energy (64), this equality is equivalent to the persistence of the dissi- 
pation in the neighborhood of the Gaussian manifold. Indeed, in according to (64) dF/dt = 
A{a'^) J q'^J{^){q)dq = A{a'^)dM2/dt, where A{a'^) docs not depend of J. On the other hand, 
time derivative of M2 due to projected equation (68) is ipa- + (f^, because M2 = + 

The second equation in (69) means, that J is projected orthogonally on ker DSTl^^o-,?- Let us 
use the orthogonality with respect to the entropic scalar product (63). The solution of equations 
(69) has the form 



da^^ _ {J\U - A).2 + M2{J){{m).2 - (MA).2) 

dt {U-h\U-h)a- 

(70) 

_ -Wa - + M2(J)((M/.).2 - (MA).2) 



where J = J(*), M2(J) ^ Sq^J{^)dq. 



Fig. 3. Phase trajectories for the two-peak approximation, FENE model: a) A stable equilibrium on 
the vertical axis, one stable peak; b) A stable equilibrium with <j > 0, stable two-peak configuration. 

It is easy to check, that the formulas (70) are indeed defining the projector: if fa (or /^) is 
substituted there instead of the function J, then we will get (^o- = 1, <^<; = (or (^o- = 0, 93,; = 1, 
respectively) . Let us substitute the right part of the initial kinetic equations (48) , calculated in 
the point ^(g) = *({c, <i}, q) (see the equation (57)) in the equation (70) instead of J. We will 
get the closed system of equations on cr^, in the neighborhood of the Gaussian manifold. 

This system describes the dynamics of the distribution function ^. The distribution function 
is represented as the half-sum of two Gaussian distributions with the averages of distribution 
±<^ and mean-square deviations a. All integrals in the right-hand part of (70) are possible to 
calculate analytically. 

Basis {fa, fq) is convenient to use everywhere, except the points in the Gaussian manifold, 
= 0, because if — > 0, then 



Let us analyze the stability of the Gaussian manifold to the "dissociation" of the Gaussian peak 
in two peaks (57). To do this, it is necessary to find first nonzero term in the Taylor expansion 
in q'^ of the right-hand side of the second equation in the system (70). The denominator has 
the order of <;'^, the numerator has, as it is easy to see, the order not less, than (because the 
Gaussian manifold is invariant with respect to the initial system). 

With the accuracy up to ^^^: 




where 



M2=0-2 



So, if q; > 0, then grows exponentially {q ~ e"*) and the Gaussian manifold is unstable; if 
a < 0, then q'^ decreases exponentially and the Gaussian manifold is stable. 

Near the vertical axis da'^/dt = l + 2aa^. The form of the phase trajectories is shown qualitative 
on Fig. 2. Note that this result completely agrees with equation (53). 

For the real equation FPE (for example, with the FENE potential) the motion in presence of 
the flow can be represented as the motion in the effective potential well U{q) = U{q) — ^nq^. 
Different variants of the phase portrait for the FENE potential are present on Fig. 3. Instability 
and dissociation of the unimodal distribution functions ( "peaks" ) for the FPE is the general 
effect when the flow is present. 

The instability occurs when the matrix d^U /dqidgj starts to have negative eigenvalues {U is 
the effective potential energy, U{q) = U (q) — | J2i,j I'^ijQiQj)- 

3.2.2 Polymodal polyhedron 

The stationary polymodal distribution for the Fokker-Planck equation corresponds to the per- 
sistence of several local minima of the function U{q). The multidimensional case is different 
from one-dimensional because it has the huge amount of possible configurations. An attempt 
to describe this picture quantitative meet the following obstacle: we do not know the potential 
U, on the other hand, the effect of molecular individualism [17,18,19] seems to be universal in 
its essence, without dependence of the qualitative picture on details of interactions. We should 
flnd a mechanism that is as general, as the effect. The simplest dumbbell model which we have 
discussed in previous subsection docs not explain the effect, but it gives us a hint: the flow can 
violate the stability of unimodal distribution. If we assume that the whole picture is hidden 
insight a multidimensional Fokker-Planck equation for a large molecule in a flow, then we can 
use this hint in such a way: when the flow strain grows there appears a sequence of bifurca- 
tions, and for each of them a new unstable direction arises. For qualitative description of such 
a picture we can apply a language of normal forms [66] , but with some modiflcation. 

The bifurcation in dimension one with appearance of two point of minima from one point has 
the simplest polynomial representation: U{q,a) = q"^ + acf. If a > 0, then this potential has 
one minimum, if a < 0, then there are two points of minima. The normal form of degenerated 
singularity is U{q) = g^. Such polynomial forms as q^ + aq"^ are very simple, but they have 
inconvenient asymptotic at g ^ oo. For our goals it is more appropriate to use logarithms of 
convex combinations of Gaussian distributions instead of polynomials. It is the same class of 
jets near the bifurcation, but with given quadratic asymptotic g — > oo. If one needs another 
class of asymptotic, it is possible just to change the choice of the basic peak. All normal forms 
of the critical form of functions, and families of versal deformations are well investigated and 
known [66]. 



Let us represent the deformation of the probability distribution under the strain in multidi- 
mensional case as a cascade of peak dissociation. The number of peaks will duplicate on the 




Fig. 4. Cartoon representing the steps of molecular individualism. Black dots are vertices of Gaus- 
sian parallelepiped. Zero, one, and four-dimensional polyhedrons are drawn. Presented is also the 
three-dimensional polyhedron used to draw the four-dimensional object. Each new dimension of the 
polyhedron adds as soon as the corresponding bifurcation occurs. Quasi-stable polymeric conforma- 
tions are associated with each vertex. First bifurcation pertinent to the instability of a dumbbell model 
in elongational flow is described in the text. 

each step. The possible cascade of peaks dissociation is presented qualitatively on Fig. 4. The 
important property of this qualitative picture is the linear complexity of dynamical description 
with exponential complexity of geometrical picture. Let m be the number of bifurcation steps 
in the cascade. Then 

• For description of parallelepiped it is sufficient to describe m edges; 

• There are 2™~^ geometrically different conformations associated with 2™ vertex of paral- 
lelepiped (central symmetry halved this number). 



Another important property is the threshold nature of each dissociation: It appears in points of 
stabihty loss for new directions, in these points the dimension of unstable direction increases. 

Positions of peaks correspond to parallelepiped vertices. Different vertices in configuration space 
present different geometric forms. So, it seems plausible^ that observed different forms ("dumb- 
bels", "half-dumbbels", "kinked", "folded" and other, not classified forms) correspond to these 
vertices of parallelepiped. Each vertex is a metastable state of a molecule and has its own 
basin of attraction. A molecule goes to the vertex which depends strongly on details of initial 
conditions. 

The simplest multidimensional dynamic model is the Fokker-Planck equation with quadratic 
mean field potential. This is direct generalization of the FENE-P model: the quadratic potential 
U (g) depends on the tensor of second moments M2 = {qiqj) (here the angle brackets denote the 
averaging). This dependence should provide the finite extensibility. This may be, for example, 
a simple matrix generalization of the FENE-P energy: 

U{q) =Y,Ki,q,q,, K = + (PiM^/b), {U{q)) = ii^KM^/b) 

where 6 is a constant (the limit of extensibility), is a constant matrix, M2 is the matrix of 
second moments, and is a positive analytical monotone increasing function of one variable on 
the interval (0, 1), 0(a;) — > 00 forx — > 1 (for example, (f){x) — — ln(l— a;)/a;, or 0(a;) = (1— a;)~^). 

For quadratic multidimensional mean field models persists the qualitative picture of Fig. 2: 
there is non-stationary moleqular individualism for stationary ''molecular collectivism". The 
stationary distribution is the Gaussian distribution, and on the way to this stationary point 
there exists an unstable region, where the distribution dissociates onto 2"* peaks (m is the 
number of unstable degrees of freedom). 

Dispersion of individual peak in unstable region increases too. This effect can deform the 
observed situation: If some of the peaks have significant intersection, then these peaks join into 
new extended classes of observed molecules. The stochastic walk of molecules between connected 
peaks can be observed as "large non-periodical fiuctuations" . This walk can be unexpected 
fast, because it can be effectively a motion in a low- dimensional space, for example, in one- 
dimensional space (in a neighborhood of a part of one- dimensional skeleton of the polyhedron). 

3.3 Generalization: neurons and particles 

The Gaussian parallelepiped (14) seems to be a "rigid" structure: the possibilities to extend this 
ansatz, to make it more exact, but with preservation of more or less transparent structure, are 

^ We can not prove it now, and it is necessary to determine the status of proposed qualitative picture: 
it is much more general than a specific model, it is the mechanism which acts in a wide class of models. 
The cascade of instabihties can appear and, no doubt, it appears for the Fokker-Planck equation for a 
large molecule in a flow. But it is not proven yet that the effects observed in well-known experiments 
have exactly this mechanism. This proof requires quantitative verification of a specific model. And now 
we talk not about a proven, but about the plausible mechanism which typically appears for systems 
with instabilities. 



not obvious. The simple transformation can improve this situation. Let us mention the obvious 
relation: exp(— (x — a)^) = exp(— x^) exp(2ax) exp(— a^). We can write the simple generalization 
of equation (14): 

m 
i=l 



where ^*(q') is the distribution density for one peak, for example, it may be the multidimensional 
Gaussian distribution ^*{q) — (2^)»/2^^/g^ ^-^P (~l ?)) > {i — i, - ■ ■ irn) are vectors in 

the configuration space, (q, q) is the usual scalar product, (pi{x) are nonnegative functions of 
one variable x. for example, (pi{x) — AiCh{aiX + (5i). 

The form (72) is more flexible then original Gaussian parallelepiped (14). It gives the possi- 
bility to extend the space for model adaptation. Functions of one variable (pi{x) are additional 
variables. They can form a flnite-parametric family: For example, v^;(.x') = AiQ\i{aix) give 
the Gaussian peaks, and if we use ipi{x) = Af exp(afx) + A~ exp{a^ x), then we obtain a 
non-symmetric picture of shifted peaks. On following steps we may use different spaces (or 
manifolds) of functions (pi{x) to extend the approximation capacity of the ansatz (72). 

Let us describe the tangent space T for the ansatz (72) with functions Xi{x) — \n(fi{x) from 
some space L. The space of functions of n variables 

m,q)) = {\{{<;,q))\^eL} 

corresponds to a given vector q and the space L. The tangent space for the ansatz (72) in 
a point ^ has a form: 

(73) 
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i=l 



' d\i{x) 
dx 



E* 



a;=(ft>?) 



where E* is the space of linear functions of q. 

If the space L includes all sufficiently smooth functions, then to avoid intersection between 
L{{qi,q)) and [ ^l^^ j _ E* it is convenient to change in equation (73) the space of all linear 

functions E* to the space of linear functions orthogonal to (^j, q), E* — {(^, q)\q ± (without 
any change in the resulting space): 



i=l 



d\i{x) 
dx 



E* 



(74) 



It means that for sufficiently rich spaces L the vectors q in the ansatz (72) could be chosen on 
the sphere, (q,q) = 1, to provide the independence of variables. 

The form (72) appears as a quasiequilibrium distribution density in the following particular 
case of the problem (27): 



Si-^) max, J S{x - (q, = fi{x), i = 1, . . . , m, 



(75) 



where S'(\l/) is the Kullback-form Boltzmann-Gibbs-Shannon entropy which measures a devia- 
tion of the distribution density ^'(g) from the equihbrium density ^*(g): 

Si^) = -J^iq)ln(^^y-q. (76) 



Hence, for fixed values of q and for a space of arbitrary nonnegative smooth functions (fii{x) 
the ansatz (72) is the quasiequihbrium approximation with macroscopic variables 

Mx)= ls{x-{<;„q))^{q)rq. 



Let us define the ansatz manifold (72) as a union of the quasiequihbrium manifolds (75) for 
all sets of values {<ii}iLi on the unit sphere. In this case we can apply Proposition 4: The 
thermodynamic projector is the orthogonal projector on with respect to the entropic scalar 
product in the point "if: In the space of density functions 



and in the conjugated space (for example, for functions A from space L in (73), (74)) 

{f,\X)% = I f,{q)X{q)^{q)dq, (78) 



where the scalar product for the conjugated space is marked by the upper index c. 
The orthogonal projector P on the direct sum of subspaces 

1=1 1=1 \ / x=(<;i,q) 



is a sum of operators: P — J2'^i{Pxi +-??*), where 

imP,, = L((,,, q)), imP,, = E*. (80) 

V / x={';i,q) 



Operators Px^, P<;i can be founded from the definition of their images (80) and the conditions: 
= P, P+ = P, where P+ is the conjugated to P operator with respect of the scalar product 
( I y (78). Prom the first equation of (P^ = P) it follows that each operator A from the set 
Q = {P\-}^i U{-P«j}jLi is a projector, — A (it may be not orthogonal), and for any pair of 
distinct projectors A,B & Q the following inclusions hold: iuiA C ker B, iuiB C ker74. 

In a general case, the constructive realization of orthogonal projector requires solution of sys- 
tems of hnear equations, or orthogonahzation of systems of vectors, etc. We shall not discuss 



the details of computational algorithms here, but one important possibility should be stressed. 
The orthogonal projection P{J) can be computed by adaptive minimization of a quadratic form: 



(J - P{J)\J- P{J))^ min for P(J) G (81) 



The gradient methods for solution of the problem (81) are based on the following simple ob- 
servation: Let a subspace L C E oi the Hilbert space E be the direct sum of subspaces Lf 
L — J2iLi. The orthogonal projection of a vector J & E onto L has an unique representation 
in a form: P{J) = x — ^i, £ -^i- The gradient of the quadratic form {J — x, J — x) in the 
space L has the form: 

grad,(J -x,J-x)^2Y,P^^{J-x), (82) 



where P^ is the orthogonal projector on the space Lj. It means: if one has the orthogonal 
projectors on the spaces Li, then he can easy write the gradient method for the problem (81). 

The projected kinetic equations, "if — x, x & Tij,, with the equations for this adaptive method, 
for example x — — /igradj,(J — x\J — x)^, can be solved together. For a rational choice of 

the step h this system is stable, and has a Lyapunov functional (for closed systems). This 
functional can be found as a linear combination of the entropy and the minimized quadratic 
form {J — x\J — x)^^J. 

We consider the FPE of the form 
d^q,t) 



dt 



= V, {D{q) [*(g, t){V,U{q) - F,,{q, t)) + V,*(g, t)]} . (83) 



Here ^{q, t) is the probability density over the configuration space q, at the time t, while U{q) 
and D(q) are the potential and the positively semi-definite ((r, D(q)r) > 0) symmetric diffusion 
matrix, Fex{q, t) is an external force (we omit here such multipliers as kBT, friction coefficients, 
etc) . Another form of equation (83) is: 

^?5M^vJB(„*.te,(v,-F„(,,t),(|MU (84) 



where ^*{q) is the equilibrium density: ^*{q, t) — exp(— C/(q'))/ / exp{—U{p))dp. For the ansatz 
(72) ^{q, t) — ^*{q) expj^i Kii'ii: Q):t)- For this ansatz the left hand side of equation (84) has 
the form 



J(^) = ^ 



x={<;i,q) J x={<;j,q) 



^ ii^^^D{q){VM<l)+Fe.{<l,t))) - (V„D(g),,)) + 

{V,U{Q),D{q)Fe,{q,t)) - {V„ D{q)F,,{q,t))] , (85) 



where Aj = Xi{x, t), and ( , ) is the usual scalar product in the configuration space. 



The projected equations have the form: 



dt 



dt 



(86) 



where the vector field J(^) is calculated by formula (85), and the projectors Paj, -P?, are defined 
by equations (80). For adaptive methods the right hand parts of equations (86) are solutions 
of auxiliary equations. 

We can return from the ansatz (72) to the polymodal polyhedron: It corresponds to a finite- 
dimensional multimodal approximation for each of equations (86). If the number of maxima 
in the approximation of \i{x) is /c,, then the number of peaks in the polymodal polyhedron is 



For the further development of the approximation (72) it is possible add some usual moments 
to the system (75). These additional moments can include a stress tensor, and some other 
polynomial moments. As a result of such an addition the equilibrium density in ansatz (72) will 
be replaced to a more general nonconstant quasiequilibrium density. 

The ansatz (72) can be discussed and studied from different points of view: 

(1) It is a uncorrelated particles representation of kinetics: The distribution density function 
(72) is a product of equilibrium density and one-particle distributions, Each particle 
has it's own one-dimensional configuration space with coordinate x = (<ji, q). The represen- 
tation of uncorrelated particles is well known in statistical physics, for example, the Vlasov 
equation is the projection of the Liouville equation onto uncorrelated ansatz [73]. There 
are three significant differences between the ansatz (72) and usual uncorrelated ansatz: 
First, the ansatz (72) is not symmetric with respect to particles permutation, second, the 
configuration spaces of particles for this ansatz are dynamic variables. The third differ- 
ence is: The ansatz (72) includes the equihbrium density function explicitly, hence, the 
uncorrelated particles represent the nonequlibrium factor of distribution, and equilibrium 
correlations are taken into account completely. 

(2) It is a version of a neural-network approximation [67]. The components of the vector q are 
input synaptic weights for the ith neuron of the hidden layer, and liiipi{x) is the activation 
function of this neuron. The activation function of the output neuron is exp(x). There 
is no need in different input synaptic weights for the output neuron, because possible 
activation functions of the neurons of the hidden layer form the linear space L, and any 
real multiplier can be included into linpi{x). The only difference from usual neural networks 
is a relatively big space of activation functions on the hidden layer. Usually, the most part 
of network abilities is hidden in the net of connections, and the only requirement to the 
activation function is their nonlinearity, it is sufficient for the approximation omnipotence 
of connectionism [68,69,70]. Nevertheless, neural networks with relatively rich spaces of 
activation functions are in use too [71,72]. 



^ — Hi ki- 



Conclusion: POET and the difference between ellipsoid and parallelepiped 

Let us introduce an abbreviation "POET" (Projection-Of-Everytliing-Tliermodynamic) for the 
thermodynamic projector. POET transforms the arbitrary vector field equipped with the given 
Lyapunov function into a vector field with the same Lyapunov function. It projects each term in 
kinetic equations into the term with the same entropy production. Moreover, POET conserves 
the reciprocity relations: if initial kinetics satisfies the Onsager relations, then the projected 
system satisfies these relations too. Thus, the problem of persistence of thermodynamic prop- 
erties in model reduction is solved. POET is unique operator which always preserves the sign 
of dissipation, any other important features of this operator follow from this preservation. 

It is necessary to use POET even for reduction of kinetic models for open systems, because 
the processes which produce the entropy in a closed system should produce the entropy in the 
open system as well: The difference between open and closed systems is the presence of entropy 
outflow (or, what is the same, of the free energy inflow), and the dissipative processes preserve 
their dissipativity. 

One of the most important impacts of POET on the model reduction technology is the new 
possibility of constructing thermodynamically consistent reduced model with almost arbitrary 
ansatz. On the other hand, it gives the possibility to create thermodynamically consistent 
discretization of the problem of model reduction [60] . 

The short memory approximation gives the coarse-grained equations. Entropy production for 
these equations is larger than for initial equations. This approach allows us to produce systems 
with dissipation from conservative systems, for example. 

It should be stressed that all the constructions, equations and statements are valid for arbitrary 
(linear or nonlinear) vector fields, classical or quantum, mechanical, or not. The only require- 
ment is: the projector field preserves the sign of dissipation, and such a field was constructed 

In this paper we discussed the important example of ansatz: the multipeak models. Two ex- 
amples of these type of models demonstrated high efficiency during decades: the Tamm-Mott- 
Smith bimodal ansatz for shock waves, and the the Langer-Bar-on-Miller approximation for 
spinodal decomposition. 

The multimodal polyhedron appears every time as an appropriate approximation for distribu- 
tion functions for systems with instabilities. We create such an approximation for the Fokker- 
Planck equation for polymer molecules in a fiow. Distributions of this type are expected to 
appear in each kinetic model with multidimensional instability as universally, as Gaussian dis- 
tribution appears for stable systems. This statement needs a clarification: everybody knows 
that the Gaussian distribution is stable with respect to convolutions, and the appearance of 
this distribution is supported by central limit theorem. Gaussian polyhedra form a stable class: 
convolution of two Gaussian polyhedra is a Gaussian polyhedron, convolution of a Gaussian 
polyhedron with a Gaussian distribution is a Gaussian polyhedron with the same number of 
vertices. On the other hand, a Gaussian distribution in a potential well appears as an exponent 
of a quadratic form which represents the simplest stable potential (a normal form of a non- 
degenerated critical point). Families of Gaussian parallelepipeds appear as versal deformations 
with given asymptotic for systems with cascade of simplest bifurcations. 



The usual point of view is: The shape of the polymers in a flow is either a coiled ball, or a 
stretched ellipsoid, and the Fokker-PIanck equation describes the stretching from the ball to 
the ellipsoid. It is not the whole truth, even for the FENE-P equation, as it was shown in ref. 
[20,59]. The Fokker-PIanck equation describes the shape of a probability cloud in the space of 
conformations. In the flow with increasing strain this shape changes from the ball to the ellip- 
soid, but, after some thresholds, this ellipsoid transforms into a multimodal distribution which 
can be modeled as the peak parallelepiped. The peaks describe the finite number of possible 
molecule conformations. The number of this distinct conformations grows for a parallelepiped 
as 2"* with the number m of independent unstable direction. Each vertex has its own basin of 
attraction. A molecule goes to the vertex which depends strongly on details of initial conditions. 

These models pretend to be the kinetic basis for the theory of molecular individualism. The 
detailed computations will be presented in following works, but some of the qualitative fea- 
tures of the models are in agreement with some of qualitative features of the picture observed 
in experiment [17,18,19]: effect has the threshold character, different observed conformations 
depend significantly on the initial conformation and orientation. 

Some general questions remain open: 

• Of course, appearance of 2™ peaks in the Gaussian parallelepiped is possible, but some of 
these peaks can join in following dynamics, hence the first question is: what is the typical 
number of significantly different peaks for a m— dimensional instability? 

• How can we decide what scenario is more realistic from the experimental point of view: the 
proposed universal kinetic mechanism, or the scenario with long living metastable states (for 
example, the relaxation of knoted molecules in the fiow can give an other picture than the 
relaxation of unknoted molecules)? 

• The analysis of random walk of molecules from peak to peak should be done, and results of 
this analysis should be compared with observed large fluctuations. 

The systematic discussion of a difference between the Gaussian elipsoid (and its generalizations) 
and the Gaussian multipeak polyhedron (and its generalizations) seems to be necessary. This 
polyhedron appears generically as the effective ansatz for kinetic systems with instabilities. 
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